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(57) A system, a method and a computer program 
are provided for simulating a combined musculoskeletal 
and augmentation device system. The dynamics model 
of the combined musculoskeletal and augmentation de- 
vice system receives computed torques at the joints as 
inputs and delivers simulated kinematic data of the seg- 
ments as outputs. The augmentation device controller 
for control of the augmentation device, receives the sim- 
ulated kinematic data as inputs and delivers assist tor- 
ques as outputs. The inverse dynamics model for the 
musculoskeletal and augmentation device system, re- 
ceives the simulated kinematic data, desired kinematic 
data of the segments and the assit torques as inputs 
and delivers the computed net joint torque and muscle 
torque. The muscle force and muscle capacity module 
for checking and adjusting the computed torques, re- 
ceives the computed torques as inputs and delivers 
computed torques as outputs after the checking and ad- 
justment. 
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Description 

CROSS-REFERENCE TO RELATED APPLICATIONS 

5 [0001] This application claims priority of U.S. provisional applications No. 60/330, 689 filed on October 29, 2001 and 
No. 60/333, 753 filed on November 29, 2001 . 

FIELD OF THE INVENTION 

10 [0002] The present invention relates to a simulation system, a simulation method and a computer program for anal- 
ysis, and synthesis of human motion under partial assist from powered augmentation devices. 

BACKGROUND OF THE INVENTION 

15 [0003] Effective usage of human assistive systems or augmentation devices for restoration or enhancement of motor 
function is an important area of research in rehabilitation and performance enhancement. A partial list of important and 
desired features of an effective assistive system include: (1) a decrease in energy rate and cost with respect to able- 
bodied subjects performing the same task, (2) minimum disruption and maximum comfort of normal activities when 
employing the assistive system, and (3) practicality. 

20 [0004] The third requirement considers the ease of wearing such a device and its power consumption needs. These 
requirements and available technology have led to the development of externally powered orthoses and prostheses 
that interface directly or indirectly with the human neuromuscular system. Although significant progress has been made 
in meeting many of the requirements needed for development of practical human assist devices (Popovic, D., Externally 
Powered and Controlled Orthotics and Prosthetics. The Biomedical Engineering Handbook, Editor Bronzino, J.D., 2nd 

25 ed. Vol. 2, Chapter 142, 2000), realization of such systems for daily applications is still in its infancy. The complexity 
of the central nervous system (CNS) control and the interface between voluntary control and external artificial control 
are still challenging, unanswered questions. 

[0005] At Honda's Wako Research Center, a mechanically powered walking assist prototype system was recently 
unveiled (Katoh and Hirata, The Concept of a Walking Assistance Suit, Welfare Engineering Symposium, The Japan 

30 Society of Mechanical Engineers, August 2001). The target application is to help the elderly and disabled people to 
either execute daily tasks they could not previously perform, or use less physical exertion than they currently employ 
for these tasks. The tasks considered include walking, lifting, sitting/standing, and climbing stairs. Two important and 
challenging questions to consider in the implementation of the Honda prototype and similar human augmentation sys- 
tems include: 1 ) analysis and monitoring of biomechanical as well as physiological quantities which cannot be readily 

35 measured and 2) the synthesis of an active control which can safely and effectively augment voluntary control. By 
developing computational methods to study these issues, future performance of human augmentation devices can be 
studied through simulation, without constraints imposed by hardware implementations of current technology. Simulation 
studies also enable us to estimate physiological quantities that cannot be easily measured, including muscle forces, 
joint forces, and energetics of motion. We can simulate effects of aging, predict muscular activity, estimate muscle 

40 fatigue and capacity, and detect potential dangerous physiological conditions. It should be mentioned that the exclusive 
use of simulation is not a substitute for eventual testing on live human subjects. However, an accurate subject-specific 
simulation allows control algorithms to be designed and refined forthe walking assist device. This is especially relevant 
in our target user population because they already have existing health constraints. 

[0006] U.S. patent No. 6,152,890 discloses a device and a method for the recording, presentation and automatic 
45 classification of biomechanical variables measured on a freely moving test person during a work shift. 

[0007] Japanese patent publication unexamined No. 2000-249570 discloses a method for generating human kine- 
matic data. 

[0008] "Gruber, K. et. al., 1998. A comparative study of impact dynamics: wobbling mass model versus rigid body 
models. Journal of Biomechanics 31 , 439-444" discloses inverse dynamics model used to simulate the human body. 
50 [0009] However, any of the above documents does not deal with analysis and synthesis of human motion under 
assist from powered augmentation devices. 

[0010] Accordingly, what is needed is a system and a method for analysis and synthesis of human motion under 
assist from powered augmentation devices. 

55 SUMMARY OF THE INVENTION 

[0011] According to one aspect of the invention, a simulation system is provided for a combined musculoskeletal 
and augmentation device system including segments and joints connecting the segments. The simulation system com- 
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prises a dynamics model of the combined musculoskeletal and augmentation device system and an augmentation 
device controller for control of the augmentation device. The simulation system further comprises an inverse dynamics 
model for the musculoskeletal and augmentation device system and a muscle force and muscle capacity module for 
checking and adjusting the computed torques. The dynamics model of the combined musculoskeletal and augmentation 

5 device system receives feasible computed torques at the joints as inputs and delivers simulated kinematic data of the 
segments as outputs. The augmentation device controllerfor control of the augmentation device, receives the simulated 
kinematic data as inputs and delivers assist torques as outputs. The inverse dynamics model for the musculoskeletal 
and augmentation device system, receives the simulated kinematic data, desired kinematic data of the segments and 
the assist torques as inputs and delivers the computed muscle torques and net joint torque as outputs. The muscle 

10 force and muscle capacity module for checking and adjusting the computed torques, receives the computed muscle 
torques as inputs and delivers feasible computed torques as outputs after making adjustments to the computed torques. 
[0012] According to another aspect of the invention, a method is provided for simulating a combined musculoskeletal 
and augmentation device system including segments and joints connecting the segments. The method comprises the 
steps of computing assist torques of the augmentation device, based on simulated kinematic data and computing 

15 torques based on the simulated kinematic data, desired kinematic data of the segments and the assist torques. The 
method further comprises the steps of checking and adjusting the computed torques and computing the simulated 
kinematic data of the segments based on the computed torques at the joints. 

[001 3] According to another aspect of the invention, a computer program for simulating a combined musculoskeletal 
and augmentation device system including segments and joints connecting the segments, is provided. The program 

20 comprises instructions of computing assist torques of the augmentation device, based on simulated kinematic data 
and of computing torques based on the simulated kinematic data, desired kinematic data of the segments, and the 
assist torques. The program further comprises instructions of checking and adjusting the computed torques and of 
computing the simulated kinematic data of the segments based on computed torques at the joints. According to the 
instructions, a computer performs each step of the operations. 

25 [0014] According to an embodiment of the invention, muscle forces are deduced from the computed torques, com- 
pared with maximum force limits and adjusted if the muscle forces exceed limits, to obtain feasible torques. 
[0015] According to another embodiment of the invention, muscle forces with and without the assist torques are 
compared in order to asses whether the assist torque control helps or hinders motion and if the assist torque control 
hinders motion the muscle forces are adjusted and feasible joint torques are computed. 

30 [0016] According to another embodiment of the invention, muscle forces with and without the assist torques are 
compared in order to asses whether the assist torque control helps or hinders motion and if the assist torque control 
hinders motion the assist torque control law is adjusted to ensure that feasible joint torques are computed. 
[001 7] According to another embodiment of the invention , muscle forces are deduced based on a static optimization 
criterion in which a sum of muscle activation squared is minimized. 

35 [0018] According to another embodiment of the invention, modified accelerations of kinematic data are obtained 
through non-linear position and velocity feedback from the simulated kinematic data. 

[0019] According to another embodiment of the invention, the kinematic data include position data, velocity data and 
acceleration data and estimates of kinematic data are computed, through non-linear feedback based on desired ac- 
celeration data, error between simulated position data and desired position data and error between simulated velocity 
40 data and desired velocity data. 

[0020] According to another embodiment of the invention, the kinematic data include position data, velocity data and 
acceleration data and estimates of kinematic data are computed, through non-linear feedback based on error between 
simulated position data and desired position data and/or error between simulated velocity data and desired velocity 
data. 

45 [0021] According to another embodiment of the invention, computed reaction forces under the segments contacting 
the ground are obtained based on the feasible computed torques and the simulated kinematic data. 
[0022] According to another embodiment of the invention, gravity compensation control algorithm is employed, in 
which the assist torques are obtained to reduce the computed muscle force by artificially compensating for the forces 
due to gravity. 

50 [0023] According to another embodiment of the invention, change in the computed torques, due to compensation 
for gravity is obtained, using coordinates of the center of the mass of the segments. 

[0024] According to another embodiment of the invention , the coordinates of the center of the mass of the segments, 
are obtained from measurements of joint angles and segment lengths. 

[0025] According to another embodiment of the invention, change in the computed torques, due to compensation 
55 for gravity, is obtained using measured reaction forces under the feet. 

[0026] According to another embodiment of the invention, the feedback gains are selected to produce the fastest 
possible non-oscillatory response. 
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DESCRIPTION OF THE DRAWINGS 
[0027] 

5 Figure 1 a biped system having five degrees of freedom in the sagittal plane with intermittent ground contact during 

double support, single support, and air-born phase; 

Figure 2 is a system model description with intermittent contact of left and right feet with the ground; 
Figure 3 is an inverse dynamics controller with position and velocity feedback for calculation of torques that when 
applied to a system model, will track and reproduce the desired kinematic data; 
10 Figure 4 is a muscle force and muscle capacity module; 

Figure 5 is a block-diagram of the integrated simulation system; 

Figure 6 is a flowchart illustrating a simulation process according to an aspect of the present invention; 
Figure 7 is a simulation of the joint angles during a squatting maneuver without employing the desired accelerations 
(a=0), in which nearly perfect tracking of desired kinematic trajectories is illustrated; 
15 Figure 8 is a simulation of the joint torques during a squatting maneuver without employing the desired accelerations 

(a=0), in which the proposed method using nonlinear feedback (NLF) produces nearly identical joint torque esti- 
mates as compared to the ground truth (ideal) joint torques obtained by a noise free inverse dynamics computation ; 
and 

Figure 9 is a simulation of the horizontal and vertical ground reaction forces during a squatting maneuver without 
20 employing the desired accelerations (a=0), in which the proposed method using nonlinearfeedback (NLF) produces 

nearly identical ground reaction estimates as compared to the ground truth (ideal) ground reaction forces obtained 
by an Iterative Newton Euler inverse dynamics procedure. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

25 

[0028] The present invention provides computational methods for analysis, and synthesis of human motion under 
partial assist from powered augmentation devices. The algorithms are integrated in a simulation platform to be used 
as a test-bed for prototyping, simulating, and verifying algorithms to control human motion under artificial control. The 
analysis and synthesis problems in human motion are formulated as a trajectory tracking control algorithm using inverse 

30 and forward models coupled by proportional and derivative feedback terms. A muscle force distribution and capacity 
module is used to monitor the computed joint torques in order to assess the physiological consequences of the artificial 
control, and if needed to make modifications. This framework allows us to verify robustness, stability, and performance 
of the controller, and to be able to quickly change parameters in a simulation environment. We can study many different 
motions in a simulation environment. Thus, future performance and designs of human augmentation devices can be 

35 studied through simulation, without the risk and constraints imposed by hardware implementations of current technol- 
ogy- 

The system model 

40 [0029] The system (or plant) refers to a dynamic model of the combined musculoskeletal and augmentation device 
system. The system may be designed having various degrees of complexity, depending on the requirements imposed 
by the study. Without loss of generality, we consider a simple planar biped system to illustrate the concepts (See Figure 
1). The equations of motion are formulated in such a way to handle three phases of biped motion as shown in Figure 
1 . They include single support, double support, and airborn. Let q be the coordinates corresponding to the rotational 

45 and translational degrees of freedom. 

q = [x 2 y 3 e 1 e 2 e 3 e 4 0 5 ] T (1) 

50 where (x 3 , y 3 ) corresponds to the center of mass of the torso and the joint angles G are measured clockwise from the 
vertical. 

[0030] The system is actuated by voluntary control from the muscles and artificial control from the augmentation 
device. The total torque applied at the joints (net joint torque) are the combined torque from the muscles (T m ) and the 
assist actuators (x a ). 

55 

* = *a + *m ( 2 ) 
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LetC(q) represent the foot-floor contact constraints and r= [r L r R ] T bethe vector corresponding to the ground reaction 
forces under the left and right feet. The equations of motion of the system are given by, 



T 

J{q)q + B( q ,q)q + G{q)+T ad = ^-V + Dr (3) 

dq 

10 where J, B, and G correspond to the inertia, coriolis and centrifugal torques, and gravitational terms, respectively. The 
vector T ad models the augmentation device dynamics and the constant matrix D characterizes the torque coupling 
effects at the joints. The matrix Dis present because absolute coordinates forthe joint angles are used in the formulation 
of the equation of motion, as opposed to relative coordinates. The ground reaction forces may be expressed as a 
function of the state and inputs by (Hemami, H., A feedback On -Off Model of Biped Dynamics. IEEE Transactions on 

15 Systems, Man, and Cybernetics, Vol. SMC-10, No. 7, July 1980). 



20 
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q + ^J(qr l tp<a>l)9 + G{q)+ T ad - Dr) 
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25 [0031] Figure 2 shows a system model description with intermittent contact of left and right feet with the ground. 
Forward dynamic simulations are performed by computing the induced accelerations '4 obtained from Equation 3 and 
Equation 4, using the simulated state variable q and q which are obtained by numerical integration. 



The internal (inverse) model 



[0032] It has been demonstrated that the behavior of the human body when coupled with a novel mechanical system 
is very similar to the behavior that results when the controller relies on an internal model. One such internal model is 
thought to be a forward model, a term used to describe the computations involved in predicting sensory consequences 
of a motor command. There are a number of studies that have suggested that a forward model may be used by the 

35 human central nervous system (CNS) to estimate sensory consequences of motor actions (Wolpert, D.M., Miall, R.C.. 
Kerr, G.K., Stein, J.F. Ocular limit cycles induced by delayed retinal feedback. Exp Brain Res., 96: 173-180, 1993; 
Flanagan. J.R., Wing, A. M. The role of internal models in motion planning and control: evidence from grip force ad- 
justment during movements of hand held loads. J. Neurosci, 17:1519-1528, 1997). This theory is easily understood 
when considering transmission delays inherent in the sensory-motor loop. Although a forward model is particularly 

40 relevant to feedback control of time delayed systems, an inverse model is sometimes considered to predict the motor 
commands that are appropriate for a desired behavior (Atkeson, C. G. Learning arm kinematics and dynamics. Annu 
Rev. Neurosci, 12:157-183, 1989; Kawato, M., Adaptation and learning in control of voluntary movement bythecentral 
nervous system. Advanced Robotics 3, 229-249, 1989; Shadmehr, R., Learning virtual equilibrium trajectories for con- 
trol of a robot arm. Neural Comput, 2:436-477, 1990; Gomi, H., Kawato, M., The cerebellum and vor/okr learning 

45 models. Trends Neurosci, 15:445-453, 1992). 

[0033] Inverse models are generally not considered for control of time delayed systems since the controller would 
seem to not have the ability to respond to the error and results in instability. However, it is plausible that local or intrinsic 
feedback mechanisms in conjunction with an inverse model can function to stabilize a system with latencies. Local 
feedback with stabilizing characteristics is believed to exist in humans in the form of viscoelastic properties of muscles 

50 and spinal reflex loop. The concept of an inverse model is also attractive for analysis problems of biomechanical quan- 
tities, whereby internal loads are estimated from kinesiological measurements. The approach adopted here in devel- 
oping a computational model of human sensory motor control is based on the concept of an inverse model coupled 
with nonlinear feedback (Figure 3). This mechanism is compelling from the standpoint of biomechanical analysis of 
human motion as well as the synthesis of artificial control. Let q d represent the desired kinematics, obtained from 

55 motion capture data. The following control law (Dr 1 ), when applied to the system equations, will result in a simulated 
response that will track and reproduce the desired kinematics data, 
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T 

DT' = j{q)q*+B{q,q)q + G{q) + T ad P (5) 



where, 



q* = aq d + K p (q d -q) + K v (q d - q) (6) 

[0034] The diagonal matrices K p and /^represent the position and velocity feedback gains, respectively. The eigen- 
values of the closed loop system are related to the feedback gains by the following, 

K p = -{X,+X 2 ) (7) 

K v = X 2 (8) 

[0035] A critically damped response (fastest possible non-oscillatory response) to the tracking error can be achieved 
by specifying the eigenvalues to be equal, real, and negative. The parameter a is constant and set to 0 or 1 , depending 
on the severity of noise in the measurements. If the desired trajectories are obtained from noisy motion capture meas- 
urements, it may be appropriate to set a=0 and to specify the eigenvalues to be large and negative. This way, tracking 
is achieved without the need to compute unreliable accelerations from noisy kinematics data. 

Muscle force and muscle capacity 

[0036] The muscleforce and muscle capacity module should ideally be implemented in the forward path of the closed 
loop system (as shown in Figure 5). However, it may also be implemented as a separate module whose output is used 
for analysis purpose only. In the latter case, the module's inputs would tap into the required variables of the closed 
loop system, but the module would not alter the closed loop dynamics. 

[0037] In either case, a number of different muscleforce distribution algorithms may be implemented. The underlying 

concepts of our choice of muscle force distribution algorithm is presented below. 

[0038] The relationship between the net muscular moment x m and the muscle forces F m is given by, 

where L is the overall length of the muscle actuator, and 3 L T /d q is an (n x m) muscle moment arm matrix. Since the 
number of muscles (m) exceeds the degrees of freedom (n), the computation of the muscle actuator's excitation inputs 
(and the resulting forces) from an inverse dynamics computation amounts to solving a problem that is inherently ill- 
posed. Static, nonlinear optimization has been used extensively to predict the individual muscle forces to produce the 
required torque. There are several compelling reasons for using static optimization to predict the individual muscle 
forces: first, static, non-linear optimization techniques have well developed theoretical foundations. With the advance 
of commercial software for solving general, constrained, multi-variable non-linear optimization problems, it is now pos- 
sible to solve sophisticated problems numerically in relatively short time. Second, the notion that muscle forces are 
controlled in some way to optimize physiological criteria has great intuitive appeal. It has been shown that for motions 
like walking, static optimization yields very similar results to dynamic optimization (Anderson, FC and Pandy, MG, 
Static and Dynamic Optimization Solutions for Gait are practically equivalent, Journal of Biomechanics 34, 2001, 
153-161, 2001). 

[0039] A muscle force and muscle capacity module takes the computed torques from the inverse model (denoted 
by Dt') as inputs and calculates the muscle forces based on a static optimization criterion (module 410 in Figure 4). 
While any cost function can be defined in solving the optimization problem, the one used here minimizes the sum of 
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muscle activations squared 



m 

j = Z"t do) 

1=1 

where m is the number of muscles crossing the joint, a f is the activation level for muscle / and is constrained to be 
10 between 0.01 and 1 .0. A muscle force F,for muscle / can be represented as below; 

F, = arf (11) 

15 where f° represents a maximum force limit for muscle /. A gradient based technique can be used to numerically solve 
for the muscle activations that minimize the cost function J while satisfying the joint moment equilibrium for all degrees 
of freedom of interest. The optimization problem can be solved using constrained nonlinear optimization (Sequential 
Quadratic Programming; AEM Design). Once the muscle activations are obtained, the muscle force can then be de- 
termined using the force-length-velocity-activation relationship of muscle (Zajac, RE. Muscle and tendon: Properties, 

20 models, scaling, and application to biomechanics and motor control. Critical Reviews in Biomedical Engineering, 17 
(4):359-41 1 , 1989 ; Anderson, FC and Pandy, MG., Static and Dynamic Optimization Solutions for Gait are practically 
equivalent, Journal of Biomechanics 34, 2001, 153-161. 2001 ; Hungspreugs, P., Thelen, D., Dariush, B., Ng-Thow- 
Hing, V., Muscle Force Distribution Estimation Using Static Optimization Techniques. Technical Report - Honda R&D 
Americas, April 2001). 

25 [0040] The computed muscle forces are then compared with physiological capacity of the muscle in the muscle 
capacity module 420. The maximum force limits can be ascertained from the well-studied force-length-velocity rela- 
tionship of muscle (Zajac 1989, cited above). In addition, the muscle forces with and without the assist torque are 
compared in order to assess whether the assist torque control has helped (improved efficiency) or hindered the motion. 
If the assist torque control hinders motion, the muscle forces are adjusted and feasible joint torques are computed 

30 (modules 430 and 440 in Figure 4). A poorly designed assist control would then result in Dt 1 ^ Dt, producing a simulated 
response that would not track the desired response. If the assist torques are well designed, Dt' = Dt and the resulting 
motion would track the desired motion. 

Augmentation device controller 

35 

[0041] The inputs to the human augmentation device may include the sensed state variables q s and/or q s , which 
can be directly measured or estimated. These inputs, denoted by (q s , q s ) represent a subset of the total number of 
state variables (q, q) in our human model. In addition to the sensed state variables, measurements may also be used 
as input to the augmentation device controller. The augmentation device controller output represents the assist torque 

40 z a , which is then input to the inverse model. 

[0042] Different control strategies may be used by the human augmentation device controller. For example, gravity 
compensation control can be used for tasks requiring an increase in potential energy of the total system (human and 
exoskeleton). Such tasks would include lifting objects, carrying loads, climbing stairs, rising from a chair, etc. A different 
control strategy, or hybrid control strategies, may be suitable for other tasks such as walking or running. Here, we will 

45 present the gravity compensation control algorithm. 

[0043] By using the Lagrangian, we can assess the total potential energy of the musculoskeletal system. Let U denote 
the total potential energy stored in the system, 

so n 

U^Y m jS T ^\ (12) 
i-l 

55 [0044] The torque at joint i due to gravity can be computed by taking the partial derivative of (7 with respect to q h 
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DT 



3U 



7=1 



n 




(13) 



where g T represents the gravitational acceleration vector, and Xj represents the coordinates of the center of mass of 
segment / Suppose the knee joint between segment 1 and segment 2 is actuated by an augmentation device and the 
angle corresponding to q 2 (represents q s ^q) is measurable. The following control law may be used as one algorithm 
for the augmentation device controller 



[0045] Note that the above control algorithm requires the center of mass positions of all the link segments (denoted 
by Xj). Although X y can be derived from measurement of joint angles and segment lengths, it may not be feasible to 
measure all joint angles and all segment lengths. Alternatively, if the vertical component of the ground reaction force 
under each foot can be measured or estimated, it is possible to derive an iterative "ground up" gravity compensation 
algorithm which would eliminate the need for access to center of mass of every segment. 

Integration of modules 

[0046] The block-diagram of the integrated modules as has been presented in the description is shown in Figure 5. 
The Augmentation device controller is presumed to have as inputs the sensed states and output the assist torques. 
The overall framework is very general and enables flexible design of the augmentation device control signals. The 
details of such designs are easily made by those skilled in the art. 

[0047] Fig. 6 shows a flowchart illustrating a simulation process according to an embodiment of the present invention. 
At step S605, timet is setto 0. At step S61 0, desired kinematic dataforthe combined musculoskeletal and augmentation 
device system are obtained. The desired kinematic data may be obtained from motion capture data. 
[0048] At step S612, the simulated kinematic data is fed back to obtain tracking error. 
[0049] At step S615, modified accelerations ? * are computed using Equation 6. 
[0050] At step 61 7, the sensed kinematic data is fed back. 

[0051] At step S620, assist torques Dr a are computed using the augmentation device controller 500. 
[0052] At step S625, torques Dr'are computed using Equation 5 (inverse model 300). 

[0053] At step S630, muscle forces are checked and adjusted to modify the corresponding torques (muscle force 
and capacity module 400). 

[0054] At step S635, the induced accelerations q are computed using Equations 3 and 4 and the simulated kinematic 
data gand gare obtained by numerical integration (modules 200, 210 and 220). 

[0055] At step S640, time t is incremented and at step S645, whether t is less than t c or not is determined. If t is less 
than t c , the process returns to step S61 0. If t is equal to or greater than t^ the process ends. 

[0056] It should be noted that the above-mentioned equations, modules or functions can be implemented in any kind 
of computing devices, including general-purpose computers such as personal computers, work stations and main frame 
computers, and ASICs (Application Specific Integrated Circuits). 

[0057] In an embodiment a general-purpose computer is employed to implement the invention. The general-purpose 
computer comprises software representing the above-mentioned equations, modules or functions. The software is 
preferably contained in computer readable mediums. Computer readable mediums include read only memories, ran- 
dom access memories, hard disks, flexible disks, compact disks and so on. 



[0058] A very simple simulation of the tracking system is carried out to illustrate some of the concepts proposed in 
the description. 

[0059] A simulation illustrating the tracking characteristics of the proposed method without acceleration estimates 
of the reference trajectory, is provided. In particular, the double support phase of the biped system during a squatting 





Simulations 
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maneuver was simulated. The results are illustrated in Figures 7 to 9. 

[0060] In Figure 7, the desired and simulated joint trajectories illustrate the effectiveness of the tracking procedure. 
These results were obtained by setting a=0, i.e. no acceleration estimates were used as inputs to the inverse model. 
The corresponding joint torques and ground reaction forces are depicted in Figure 8 and Figure 9, respectively. 
5 [0061] It should be noted that those skilled in the art can modify or change the above-mentioned embodiments, 
without departing from the scope and spirit of the present invention. It should therefore be noted that the disclosed 
embodiments are not intended to limit the scope of the invention, but only to exemplarily illustrate the invention. 



10 Claims 

1. A simulation system for a combined musculoskeletal and augmentation device system including segments and 
joints connecting the segments, the simulation system comprising; 

15 a dynamics model of the combined musculoskeletal and augmentation device system, receiving computed 

torques at the joints as inputs and delivering simulated kinematic data of the segments as outputs; 
an augmentation device controller for control of the augmentation device, receiving the simulated kinematic 
data as inputs and delivering assist torques as outputs; 

an inverse dynamics moduleforthe musculoskeletal and augmentation device system , receiving the simulated 
20 kinematic data, desired kinematic data of the segments and the assit torques as inputs and delivering the 

computed torques; and 

a muscle force and muscle capacity module for checking and adjusting the raw computed torques from the 
inverse module, receiving the raw computed torques as inputs and delivering adjusted computed torques as 
outputs after verification of feasibility and adjustments. 

25 

2. A simulation system according to claim 1 wherein the muscle force and muscle capacity module deduces muscle 
forces from the computed torques, compares the muscle forces with maximum force limits and adjusts a muscle 
force if the muscle force exceeds a limit, to adjust the corresponding computed torque. 

30 3. A simulation system according to claim 1 or 2 wherein muscle forces with and without the assist torques are 
compared in orderto asses whether the assist torque control helps or hinders motion and if the assisttorque control 
hinders motion the muscle forces are adjusted and feasible joint torques are computed. 

4. A simulation system according to claim 2 or 3 wherein the muscle force and muscle capacity module deduces 
35 muscle forces based on a static optimization criterion in which a sum of muscle activation squared is minimized. 

5. A simulation system according to any one of claims 1 to 4 wherein the inverse dynamics model obtains modified 
accelerations of kinematic data through non-linear feedback of the simulated kinematic data. 

40 6. A simulation system according to 5, wherein the kinematic data include position data, velocity data and acceleration 
data and the inverse dynamics model calculates modified accelerations of kinematic data, through non-linear feed- 
back based on desired acceleration data, error between simulated position data and desired position data and 
error between simulated velocity data and desired velocity data. 

45 7. A simulation system according to 5, wherein the kinematic data include position data, velocity data and acceleration 
data and the inverse dynamics model calculates modified accelerations of kinematic data, through non-linear feed- 
back based on error between simulated position data and desired position data and/or error between simulated 
velocity data and desired velocity data. 

50 8. A simulation system according to 5, wherein the feedback gains are selected to yield a critically damped response 
to produce the fastest possible non-oscillatory behavior. 

9. A simulation system according to any one of claims 1 to 8, further comprising a ground reaction force model 
receiving the computed torques and the simulated kinematic data as inputs and delivering simulated reaction forces 

55 under the segments contacting the ground as outputs. 

10. A simulation system according to any one of claims 1 to 9, wherein the augmentation device controller employs 
gravity compensation control algorithm in which the augmentation device controller obtains the assist torques to 
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compensate for the forces due to gravity and alter the computed muscle torque due to the compensation for gravity. 

11. A simulation system according to claim 10, wherein the augmentation device obtains change in the computed 
muscle torques, due to gravity assist control, using coordinates of the center of the mass of the segments. 

5 

1 2. A simulation system according to claim 1 1 , wherein the augmentation device obtains the coordinates of the center 
of the mass of the segments, from measurements of joint angles and segment lengths. 

13. A simulation system according to claim 10, wherein the augmentation device obtains change in the computed 
10 muscle torques, due to gravity assist control, using measured reaction forces under the feet. 

14. A method for simulating a combined musculoskeletal and augmentation device system including segments and 
joints connecting the segments, the method comprising the steps of: 

15 computing assist torques of the augmentation device, based on simulated kinematic data; 

computing net joint torque and muscle torque based on the simulated kinematic data, desired kinematic data 

of the segments and the assist torques; 

checking and adjusting the computed muscle torques; and 

computing the simulated kinematic data of the segments based on the computed torques at the joints. 

20 

15. A method according to claim 14, the step of checking and adjusting the computed torques comprises deducing 
muscle forces from the computed muscle torques, comparing the muscle forces with maximum force limits and 
adjusting a muscle force if the muscle force exceeds a limit, to adjust the corresponding computed torque. 

25 16. A method according to claim 15, wherein the step of checking and adjusting the computed torques comprises 
comparing muscle forces with and without the assist torques in order to asses whether the assist torque control 
helps or hinders motion and adjusting the muscle forces and computing feasible joint torques if the assist torque 
control hinders motion. 

30 17. A method according to claim 15, wherein the step of checking and adjusting the computed torques comprises 
comparing muscle forces with and without the assist torques in order to asses whether the assist torque control 
helps or hinders motion and designing the proper assist control law to ensure that the assist torque help the effi- 
ciency of motion. 

35 1 8. A method according to claim 1 5 or 1 6, wherein muscle forces are deduced, based on a static optimization criterion 
in which a sum of muscle activation squared is minimized. 

1 9. A method according to any one of claims 1 4 to 1 8, wherein the step of computing the computed torques comprises 
computing modified accelerations of kinematic data through non-linear feedback of the modified accelerations 

40 kinematic data. 

20. A method according to claim 19, wherein the kinematic data include position data, velocity data and acceleration 
data and computing modified accelerations of kinematic data are computed through non-linear feedback based 
on desired acceleration data, error between simulated position data and desired position data and error between 

45 simulated velocity data and desired velocity data. 

21. A method according to claim 19, wherein the kinematic data include position data, velocity data and acceleration 
data and computing modified accelerations of kinematic data are computed through non-linear feedback based 
on error between simulated position data and desired position data and error between simulated velocity data and 

50 desired velocity data. 

22. A method according to any one of claims 14 to 21 , wherein the step of computing simulated kinematic data of the 
segments comprises computing the reaction forces under the segments contacting the ground, based on the com- 
puted torques and the simulated kinematic data. 

55 

23. A method according to any one of claims 1 4 to 22, wherein the step of computing assist torques of the augmentation 
device is performed employing gravity compensation control algorithm in which the augmentation device controller 
obtains the assist torques to compensate for the forces due to gravity. 
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24. A method according to claim 23, wherein change in the computed muscle torques, due to change in the gravity 
assist torque, are computed using coordinates of the center of the mass of the segments. 

25. A method according to claim 24, wherein the coordinates of the center of the mass of the segments, are obtained 
5 from measurements of joint angles and segment lengths. 

26. A method according to claim 23, wherein change in the computed muscle torques, due to change in the gravity 
assist torque, are computed using measured reaction forces under the feet. 

10 27. A computer program containing a program for simulating a combined musculoskeletal and augmentation device 
system including segments and joints connecting the segments, the program comprising instructions of: 

computing assist torques of the augmentation device, based on simulated kinematic data; 
computing torques based on the simulated kinematic data, desired kinematic data of the segments and the 
15 assist torques; 

checking and adjusting the computed torques; and 

computing the simulated kinematic data of the segments based on computed torques at the joints. 
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FIG. 2 
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FIG. 4 
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FIG. 7 
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FIG. 9 
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